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(54) Image processing method 



(57) An image is divided into blocks 
and the picture elements in each block 
are sorted into a first group of picture 
elements of higher density and a 
second group of picture elements of 
lower density. Representative 
densities, such as the mean density, 
are obtained for each group in each 



block and histograms of the 
representative densities are 
constructed. The image is 
discriminated into one of a number of 
kinds, e.g. line pattern, low-contrast 
gradation and nigh-contrast gradation 
in accordance with the histograms 
and threshold values therefrom, and 
the image information converted into 
binary signals according to the 
threshold values. 
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SPECIFICATION 

Image processing method 

The present invention relates to image 
processing methods, in which, upon 
5 discrimination of the image into one of a number 
of kinds of image, the image signals are then 
converted into binary signals by a means 
appropriate to the kind of image. 

In recent years, a remarkable increase in 

1 0 capacity has been attained in storage media such 
as RAMs, hard discs, optical discs and magnetic 
discs, due to the development of memories of 
large storage capacities. In addition, there is a 
rapid movement for putting optical discs into 

1 5 practical use, as well as development and studies 
on the magnetic discs and, nowadays, it is 
possible to write image information in such 
recording media. For instance, an optical disc can 
store about 10,000 (ten thousand) sheets of A-4 

20 size documents. It is, therefore, a current tendency 
to use memories of large capacity, for the storage 
of image information. Attempts have also been 
made to code and compress the image 
information to be written, in order to further 

25 increase the amount of storage of image 
information in the memory. 

On the other hand, there is an increasing 
demand for making a hard copy of the image 
information read out of the memory. Various 

30 recording systems are available for this purpose. 
In the case of heat-sensitive recording systems, 
the recording speed is too low, although it permits 
an output on the order of 1 6 grades of gradation. 
On the other hand, electrostatic recording 

35 systems {multi-stylus system) suffers from a 
problem that the gradation reproduction is 
affected too much by environmental conditions, 
although the recording speed can be increased. 
Under these circumstances, an image recording 

40 system making use of binary dots (white and 
black) is attracting attention because it can obviate 
the above-mentioned problems. In this system, in 
order to materially reproduce half tone with the 
apparatus which can record only two values of 

45 white and black, it is necessary to covert the 
image information into binary signals. Some 
methods are known for binary coding the picture 
information, such as binary coding merely by 
employing a single threshold value and a so-called 

50 dither method. It is a key for attaining a high 

quality of the reproduced image to adequately set 
the threshold value or the dither matrix (threshold 
value group), in conducting the binary coding. 
An object of the invention is to provide an 

55 image processing method capable of setting a 
threshold value or the threshold value group 
suitable for the binary coding of the image 
information. 

According to the present invention there is 

60 provided an image processing method 
comprising the steps of : 

dividing an image into a plurality of blocks, 
each block comprising a plurality of picture 
elements; 



65 sorting the picture elements in each block into 
a first group consisting of picture elements 
of densities not lower than a reference 
density and a second group consisting of 
picture elements of densities lower than the 

70 reference density; 

obtaining a representative density of picture 
elements of said first group in each block; 
obtaining a representative density of picture 
elements of said second group in each block; 

7 5 effecting an image discrimination in 

accordance with said representative 
densities; 

effecting a determination of threshold value in 
accordance with said representative 
80 densities and the result of said image 

discrimination; and 
converting image information into binary 

signals according to said threshold value. 
An embodiment of the invention will now be 
85 described, by way of example, with reference tc 
the accompanying drawings, in which: 

Figure 1 is an illustrative diagram showing the 
dividing of an image into a plurality of blocks; 
Fig. 2 and Fig. 3 are density histograms 
90 prepared with the density signals obtained by " 
scanning a line pattern; 

Fig. 4 and Fig. 5 are density histograms 
prepared with the density signals obtained by 
scanning a gradation image; 
95 Fig. 6 is a flow chart showing an example of 
the processing procedure in accordance with the 
method of the invention; 

Figs. 7 and 8 are illustrations concerning the 
expansion and shift of the threshold value group; 
100 and 

Figs. 9 and 1 0 are illustrations of essential 
parts of the apparatus for carrying out the method 
of the invention. 

According to the invention, the image is 
1 05 sectioned into the group of blocks each of whic h 
having 4x4 picture elements (see Fig. 1 ). Then, 
mean density 

ZZ 

Xt(=ij Xij/N) 

is determined from the densities Xij of the picture 
1 1 0 elements (i, j) and the number N of the picture 
elements. Then, the picture elements in each 
block is classified into a first group of picture 
elements (number: N,) of densities not lower than 
the mean density Xt and a second group of 
1 1 5 picture elements (number: N 2 , N t +N 2 =N) of 

densities lower than the mean density Xt. Then, 
density representative values of respective 
groups, e.g. the mean values of densities of 
picture elements in respective groups, are 
1 20 determined as follows. 

a '=Xij>Xt Xi ^ < 1 > 

a -xlj<xt Xi ^ ,2) 
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Then, the discrimination of image and the 
determination of the threshold value is conducted 
by using the thus obtained density representative 
values a t and a 2 . 
5 An explanation will be made hereinunder as to 
the difference of density histogram according to 
the kind of the image. Fig. 2 shows a histogram of 
the density representative values a, and a 2 of 
image information obtained when a line pattern 
1 0 (character image in books or the like) through a 
scanning at a density of 8 picture elements/mm. 
More specifically, in Fig. 2, the full line is the 
histogram of a, represented by the formula (1), 
while broken line shows the histogram of a 2 
1 5 represented by the formula (2). This histogram is 
obtained because, in the case of the line pattern, 
the lines are dark while the background is bright. 
It will be seen that, while the histogram of the 
value a, has two peaks, i.e. a peak in the high- 
20 density side and a peak in the low-density side, 
the histogram of the value a 2 has only one peak in 
the low-density side with low frequency in the 
high-density side. However, in the both 
histograms, the peak value in the low-density side 
25 is obtained at an equal density. This density will 
be referred to as "peak density value", 
hereinunder. This applies also to the line pattern 
of smaller line width and lower density. Fig. 3 is a 
histogram as obtained with line pattern of smaller 
30 line width and lower density, in which the 

histograms of the values a 1 and a 2 are shown by a 
full line and broken line, respectively, as in the 
case of Fig. 2. The coincidence of the peak density 
values at the lower-density side is confirmed also 
35 from this Figure. 

Thus, the line pattern has features peculiar 
thereto that the histograms of the values a } and a 2 
have a common peak value density at the low- 
density side and that the histogram of the value a, 
40 have a peak in the high-density side while the 

histogram of the value a 2 has low frequency in the 
low-density side. 

Figs. 4 and 5 show histograms obtained with 
gradation images. More specifically, Fig. 4 shows 
45 the histogram for an image of a scenery or 

landscape having a high contrast, while Fig. 5 is a 
histogram for an image of a person (female with 
colored background) of a low contrast. In these 
Figures, the histograms of the values a, and a 2 are 
50 represented by full lines and broken lines, 

respectively. As will be seen from these Figures, 
in the case of a gradation image, the peak value 
densities do not coincide with each otheV or, if the 
peak value densities coincide with each other, a 
55 considerable frequency is observed in the high- 
density side. It is also understood that the higher 
contrast of image as shown in Fig. 4 provides a 
greater distance between peak values of the 
histrograms for the values a, and a 2 . These 
60 tendencies apply also to other gradation images. 
It is, therefore, possible to make a 
discrimination of the kind of the image by 
conducting a processing by a procedure as shown 
by a flow chart in Fig. 6. Namely, the density 
65 representative values a, and a 2 of the groups of 



higher and lower densities are read for each of the 
blocks, and histograms are made out of these 
values. Then, crests and valleys of the histograms 
for the density representative values a, and a 2 are 

70 determined and the peak density values are 
detected. When the peak value densities of 
histograms of the density representative values a, 
and a 2 discord with each other, the image can be 
judged to be a gradation image of high contrast, 

75 because such a discordance is observed only 
when the image is a gradation image of high 
contrast. 

On the other hand, when the peak value 
densities accord with each other, a judgement is 

80 made as to whether the accumulative value of the 
frequency in the density region higher than a 
predetermined density Dn 0 is greater than a 
judgement threshold value M in the histogram of 
the density representative value a 2 , i.e. whether 

85 the following condition (3) is met. 



£ 9 (Dn)<M 
Dn>Dn 0 



(3) 



As stated before, no distribution to the high- 
density side is observed in the line pattern. It is, 
therefore, judged that the image is a line pattern, 

90 when the condition of formula (3) is met. On the 
other hand, when the condition of formula (3) is 
not met, the image is judged to be a gradation 
image of a low contrast such as that shown in Fig. 
5, because only the image as shown in Fig. 5 fails 

95 to meet this condition. As an alternative measure 
for the discrimination, it is possible to use the 
ratio of accumulative values of the values a, and 
a 2 . 

There is a certain correlation between Dn 0 and 
1 00 M, so that one is determined after the 

determination of the other. It is, however, 
preferred that the values Dn 0 and M are selected 
to range between 0.1 and 0.7 and between 0 and 
0.9, respectively. In some kinds of images, a local 
1 05 density unevenness is observed in the 

background, as in the cases of diazo documents 
and newspapers. When histograms are made for 
such images, the unfavourable effect of the local 
density unevenness can be removed by reducing 
110 the level number of the densities of picture 

elements. For instance, while in the usual case the 
sampling is made at 8 bits to provide 256 levels, 
the level number is reduced to 64 by combining 4 
levels into one or to 32 levels by combining 8 
1 1 5 levels into one, i.e. to 5 bits. 

After the discrimination of the image, the 
threshold value or the threshold value group is 
determined as follows. 

(1) Line pattern 

1 20 One density value in the valley in the histogram 
of the representative value a, in the higher- 
density side is selected and used as the threshold 
value. 

(2) Gradation image of high contrast 

1 25 A max, the maximum value of the density 

representative value a^ and A min, the minimum 
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value of a 2 are determined, and the threshold 
value group is formed by using the values A 
ranging between A min and A max. When the 
binary coding is conducted by making use of 
5 Dither method, it is preferred to select a smaller 
size of the Dither matrix or to select a Bayer type 
pattern. 

(3) Gradation image of low contrast 

The range of the threshold value is determined 

1 o in the same manner as the image (2) mentioned 
above. When the binary coding is conducted by the 
Dither method, it is preferred to select a larger 
size of the Dither matrix or to use a vortex or 
network pattern as the pattern. 

1 5 In the cases of the gradation images 

mentioned in (2) and (3) above, the ranges of the 
threshold value varies depending on the density 
range of the document. Fig. 7 shows, by way of 
example, the calculation of the threshold value 

20 range by means of Dither matrix. Namely, Fig. 7 
shows an example of the procedure of the 
calculation of the Dither matrix used for the actual 
binary coding from a basic Dither matrix. More 
specifically, the matrix (a) is the basic matrix, 

25 while the matrix (b) is a dither matrix which is 
obtained by multiplying respective threshold 
values in the basic Dither matrix by 1/2. The 
matrix (c) is the matrix which is obtained by 
adding 5 to respective threshold values in the 

30 Dither matrix (b). In this manner, it is possible to 
freely expand, contract or shift the threshold value 
ranges while preserving the characteristics of the 
basic Dither matrix. Generally, provided that the 
range of the threshold value in the basic dither 

35 matrix Mo is the line 1 m in the set density region 
as shown in Fig. 8 and that the range of the 
threshold value of the Dither matrix M, necessary 
for the binary coding of the image is given as 
the line pq (see Fig. 8), the factor K of 

40 multiplication for expanding the matrix from (a) to 
(b) and the amount S of shift for shifting the 
matrix from (b) to (c) can be obtained through 
calculations in accordance with the following 
formulae: 

45 K=(q-p)/(m-l) 

S=p-I 

The image signals are binary coded by means 
of the thus selected new threshold value or the 
threshold value group. 

50 An explanation will be made hereinunder as to 
an example of image processing apparatus for 
carrying out the method of the invention, with 
specific reference to Fig. 9. In this Figure, a 
reference numeral 10 denotes a storage device 

55 storing coded image information obtained 

through the block coding method, 1 1 designates 
a central processing unit (referred to as "CPU", 
hereinunder) for making arithmetic operations 
such as making of histograms and judgement 

60 such as discrimination of images, 1 2 designates a 
histogram-making memory (RAM) adapted to 



collect and store the data from the CPU 1 1 and to 
deliver the collected data to the CPU 1 1 , and 1 3 
designates a memory (ROM) for memorizing the 

65 programs of the arithmetic operations to be 

performed by the CPU 1 1 and programs of other 
operations. A reference numeral 1 4 denotes a 
memory (ROM) for storing the basic threshold 
value or the basic threshold value group, 1 5 

70 denotes a computing unit which reads threshold 
value group of a predetermined distribution 
frequency from the memory 1 4 and to make a 
predetermined computation, and 1 6 designates a 
memory (RAM) for storing new threshold value 

75 group outputted from the computing unit 1 5. A 
reference numeral 1 7 designates a duplication 
circuit for duplicating the coded image 
information outputted from the memory device 
1 0, while 1 8 denotes a comparator which 

80 compares the output (image signal) from the 

duplicating circuit 1 7 with the output (threshold , 
value) from the memory 1 6 to produce binary | 
signals. 

The operation of the image processing 
85 apparatus having the described construction is as 
follows. 

First of all, the CPU 1 1 reads the density 
representative values a, a 2 from the memory 
device 1 0 and makes out histograms relating to 
90 the density representative values a, and a 2 within 
the memory 1 2. The reading is made for all of the 
blocks to complete two histograms. Then, the 
CPU 1 1 performs the detection of the peak 
density values with the aid of the memories 1 2 
95 and 1 3, and discriminates the image through two 
judgements explained before in connection with 
Fig. 6. The CPU 1 1 then delivers the value or 
range to be taken as the threshold value or the 
threshold value group to the computing unit 1 5. 

100 The computing unit 1 5 then reads out the basic 
threshold value or the basic threshold value group 
from the memory (ROM) 1 4 in accordance with 
the output from the CPU 1 1 , and makes a 
computation of new threshold value or new 

1 05 threshold value group from the thus read out 

threshold value or threshold value group. The new 
threshold value or threshold value group is written 
in the memory 1 6. The image signals are binary- 
coded by the comparator 1 8, in accordance with 

1 1 0 this new threshold value or threshold value group. 
The above-described procedure for carrying 
out the invention is not exclusive. For instance, 
the histograms of the density representative 
values a, and a 2 may be made in series instead of 

115 being formed simultaneously, or the function of 
the CPU 1 1 may be widened to cover the function 
of the computing unit 1 5. 

In the case where the image information to be 
processed is not code-compressed by the block 

1 20 coding method, the CPU 1 1 reads image 

information from an image input device such as 
CCD sensor directly or indirectly through an 
image memory and conducts the discrimination of 
the image and the setting of the threshold value 

125 following the computation of the density 
representative values and a 2 , thereby to 
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perform the binary coding of the image 
information. The same procedure can be applied 
also to the case where an image memory storing 
the image information is prepared and the image 
5 information stored in the image memory are 
processed. 

Fig. 10 shows another example of the image 
processing apparatus for carrying out the method 
of the invention. In this apparatus, the making of 
1 0 the histograms, discrimination of images and the 
setting of the threshold value are made in the 
same manner as that in the apparatus shown in 
Fig. 9. The apparatus shown in Fig. 1 0, however, 
is distinguished from the apparatus shown in Fig. 
15 9 in that it does not employ the CPU, and in that it 
does not process the block-coded image 
information but the processing is made while 
reading the image by means of an image sensor. 
The construction and operation of the apparatus 
20 shown in Fig. 10 will be explained hereinunder. It 
is assumed here that each block includes 4x4 
picture elements. 

The density signals of the image outputted 
from the image sensor 20 is sampled by means of 
25 a sample hold circuit 2 1 and is converted into 
digital signals by means of an A/D converter 22. 
The digital signals are then stored in four line 
memories 23a to 23d and an image memory 24. 
Needless to say, the number of the line memories 
30 can be increased in accordance with the speed of 
the subsequent processing. The outputs from the 
line memories 23a to 23d are delivered, in terms 
of the block, to a block averaging circuit 25 and 
block memories 26a to 26d. The block averaging 
35 circuit 25 determines the mean density Xt of the 
picture elements within a block. The mean density 
Xt, i.e. the output from the mean circuit 25, is 
compared by comparators 27a to 27d with the 
densities of the picture elements in the block, i.e. 
40 with the outputs from block memories 26a to 26d 
in the block. When the density of a picture 
element is not exceeded by the mean density Xt, 
the signal representing the density of this picture 
element is latched within a primary averaging 
45 circuit 28. To the contrary, when the picture 

element density is exceeded by the mean density 
Xt, the picture element density signal is latched in 
a secondary averaging circuit 29. The density 
representative values a, and a 2 for this block are 
50 determined by these two averaging circuits 28 
and 29. From the view point of shortening of the 
data processing time, it is preferred to conduct 
the computation in a parallel manner by 'sending, 
after delivering the picture density signals to the 
55 averaging circuits 28 and 29, the picture element 
density signals of the next block from the line 
memories 23a to 23d to the memories 26a to 
26d in the block and also to the block averaging 
circuit 25. The density representative values a, 
60 and a 2 thus determined by the averaging circuits 
28 and 29 are delivered to the histogram making 
circuit 30 which makes out the histograms. 

Then, a density peak agreement detecting 
circuit 31 examines whether the corresponding 
65 peak value densities in the histograms of the 



values a, and a 2 agree with each other and 
delivers the result to a decision circuit 32. On the 
other hand, an accumulative value operation 
circuit 33 calculates the accumulative value of 

70 frequency of values in the region of density higher 
than a predetermined density in the histogram of 
the density representative value a 2 . The output 
from this circuit 33 is compared in the 
comparator circuit 34 with the threshold value 

75 and the result of this comparison is delivered to 
the decision circuit 32. Upon receiving a signal 
representing the discordance of peak density 
values from the agreement detecting circuit 3 1 , 
the decision circuit 32 make a decision that the 

80 image is a gradation image of a high contrast, 
regardless of the nature of the output from the 
comparator circuit 34. On the other hand, when 
the peak density values of both histograms agree 
with each other, the decision circuit 32 decides 

85 whether the accumulative value is greater or 
smaller than the threshold value, making use of the 
output from the comparator circuit 34. Namely, 
when the threshold value is exceeded by the 
accumulative value, the decision circuit decides 

90 that the image is a gradation image of a low 

contrast, whereas, when the accumulative value 
is smaller than the threshold value, the decision 
circuit decides that the image is of a line pattern. 
In accordance with the result of the decision, the 

95 decision circuit 32 delivers the value or range to 
be taken as the threshold value of threshold value 
group to a threshold output circuit 35. Then, a 
comparator 36 conducts the binary coding of the 
image information stored in the image memory 

1 00 24, by making use of the output from the 

threshold output circuit 35. In this apparatus, it is 
possible to arrange such that the calculation of 
the accumulative value is conducted only when 
the agreement of the peak densities is confirmed. 

1 05 As has been described, according to the 

invention, the threshold value or the threshold 
value group necessary for the binary coding of the 
image information can be set automatically in 
accordance with the kind of the image. It is 

110 therefore, possible to effect the binary coding of 
the information signal so as to ensure good 
quality of the reproduced image regardless of the 
kind of the image. 

Claims 

115 1 . An image processing method comprising the 
steps of: 

dividing an image into a plurality of blocks, 
each block comprising a plurality of picture 
elements; 

1 20 sorting the picture elements in each block into 
a first group consisting of picture elements 
of densities not lower than a reference 
density and a second group consisting of 
picture elements of densities lower than the 

125 reference density; 

obtaining a representative density of picture 
elements of said first group in each block; 
obtaining a representative density of picture 
elements of said second group in each block; 
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effecting an image discrimination in 
accordance with said representative 
densities; 

effecting a determination of threshold value in 
5 accordance with said representative 

densities and the result of said image 
discrimination; and 
converting image information into binary 
signals according to said threshold value. 
10 2. An image processing method according to 
claim 1 , wherein said reference density is the 
mean density of picture elements in each block. 

3. An image processing method according to 
claim 2, wherein the image discrimination and the 

1 5 determination of threshold values are conducted 
by using histograms made out from said 
representative density of picture elements of the 
first group in each block and said representative 
density of picture elements of the second group in 

20 each block. 

4. An image processing method according to 
claim 3, wherein an effective density value at a 
valley portion of said histogram for the effective 
density representative value at the higher density 

25 side out of said effective density representative 
values is adopted as a threshold value for the line 
pattern, and the binary coding is made by making 
use of this threshold value. 

5. An image processing method comprising the 
30 steps of: 

dividing an image into a plurality of blocks, 
each block comprising a plurality of picture 
elements; 

sorting the picture elements in each block into 
35 a first group consisting of picture elements 

of densities not lower than a reference 
density; and a second group consisting of 
picture elements of densities lower than the 
reference density; 
40 obtaining a representative density of picture 
elements of said first group in each block; 
obtaining a representative density of picture 

elements of said second group in each block; 
effecting an image discrimination in 
45 accordance with said representative 

densities; 



determining the maximum and minimum 

values of said representative densities; 
forming a threshold value group with a plurality 
50 of effective density values ranging between 

said maximum and minimum values; and 
conducting the binary coding for a gradation 

image according to the threshold value 

group. 

55 6. An image processing method comprising the 
steps of: 

dividing an image into a plurality of blocks, 
each block comprising a plurality of picture 
elements; 

60 sorting the picture elements in each block into 
a first group consisting of picture elements 
of densities not lower than a reference 
density and a second group consisting of 
picture elements of densities lower than the 

65 reference density; 

obtaining a representative density of picture 
elements of said first group in each block; 
obtaining a representative density of picture 
elements of said second group in each block; 

70 effecting an image discrimination in 

accordance with said representative 
densities; 

determining the maximum and the minimum 
values of said representative densities; 
75 forming a Dither matrix having elements 

constituted by a plurality of effective density 
values ranging between the maximum and 
the minimum value; and 
converting image information into binary 
80 signals by adopting the smaller size of said 

Dither matrix or a specific pattern for a high- 
contrast gradation image while adopting the 
greater size of said Dither matrix or a specific 
pattern for a low-contrast gradation image. 
85 7. An image processing method according to 
claim 1 and substantially as described herein with 
reference to the accompanying drawings. 

8. Image processing apparatus for carrying o, 
the method of claim 1 and substantially as 
90 described herein with reference to the 
accompanying drawings. 
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